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METHOD AND APPARATUS FOR SESSION MANAGEMENT AND 
USER AUTHENTICATION 

BACKGROUND QE THE INVENTION 
1. HELD OF THE INVENTION 

This invention relates computer, systems and, more specifically, to 
user authentication and the location management of user sessions. 

5 2. BACKGROUND ART 

The paradigms by which computer systems have been configured 
have changed over time. In earlier times, a computer consisted of a so called 
"mainframe" computer that was accessed by a plurality of "dumb terminals". 
The mainframe was a central station that provided computational power 
10 and data storage. A dumb terminal was a display device for data provided by 
the mainframe, and also provided a means to communicate some data to 
the mainframe. Other system paradigms followed, including the desktop 
computer, client/server architectures, and recently, the so-called network 
computer. 

15 A desktop computer is a self contained computing system where all 

applications and data are resident on the desktop computer system itself. 
Such systems were implemented in personal computers and have spurred 
the use of computers in homes and offices. A disadvantage of desktop 
computers is the short lifetime of the hardware used in the system. Desktop 

20 computers are microprocessor driven, and as faster and more powerful 

microprocessors become available, upgrades of existing desktop systems, or 
purchase of new desktop systems, is required. In many offices, there are 
personal desktop computers distributed throughout, sometimes numbering 
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in the thousands and tens of thousands. A disadvantage of such large . 
systems is the lack of compatibility of applications and data on individual 
systems. Some users may have more recent versions of software 
applications that are not backwards compatible with older versions of the 
5 software. The solution to this problem is to maintain consistent software on 
all systems. However, the cost to upgrade each system and to provide 
licensed copies of software and software upgrades can be substantial. 

Client server systems are systems where central stores of data and /or 
applications are accessed through a network by personal computer clients. 
10 This provides some administrative efficiency in maintaining the shared 
data. However, the clients still have local applications and data that can 
present the same kinds of problems faced in the desktop systems already 
described. 

Recently, the rise of the internet has resulted in the proposed use of 
15 so-called "network computers". A network computer is a stripped down 
version of a personal computer with less storage space, less memory, and 
often less computational power. The idea is that network computers will 
access data through the internet, and only those applications that are needed 
for a particular task will be provided to the network computer. When the 
20 applications are no longer being used, they are not stored on the network 
computer. There has been some criticism of such systems as lacking the 
power of a full desktop system, yet not being inexpensive enough to justify 
the reduced capability. And even though the network computer is a subset 
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of a desktop computer, the network computer may still require upgrades -of 
hardware and software to maintain adequate performance levels. 

An example of a dynamic host configuration protocol is provided in 
RFC 2131. RFCs 1321 and 2104 contain examples of MD5, or message 
5 digesting. A point to point challenge host authentication protocol is 
contained in RFC 1994. 
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SUMMARY OF THE INVENTION 

Authentication and session management can be used with a system 
architecture that partitions functionality between a human interface device 
(HID) and a computational service provider such as a server. An 
5 authentication manager executing on a server interacts with the HID to 
validate the user when the user connects to the system via the HID. A 
session manager executing on a server manages services running on 
computers providing computational services (e.g., programs) on behalf of 
the user. The session manager notifies each service in a session that the user 

10 is attached to the system using a given desktop machine. A service can 
direct display output to the HID while the user is attached to the system. 
When a user detaches from the system, each of the service's executing for 
the user is notified via the authentication manager and the session manager. 
Upon notification that the user is detached from the system, a service 

15 continues to execute while stopping its display to the desktop machine. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is an example of system architectures used in one or more 
embodiments of the invention. 

Figure 2 illustrates authentication and session management 
5 components and their interactions according to an embodiment of the 
invention. 

Figure 3 provides a process flow for initializing a network terminal in 
response to a power up operation according to an embodiment of the 
invention. 

0 Figures 4A-4C provide a process flow according to an embodiment of 

the invention for initializing network terminal 202 in response to an 
awaken operation. 

Figures 5A-AB provide an authentication process flow according to an 
embodiment of the invention. 

5 Figure 6 provides a challenge process flow according to an 

embodiment of the invention. 

Figures 7 and 8 provide examples of system architectures used in one 
or more embodiments of the invention. 
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DETAILED DESCRIPTION OF THE INVF.NTTDN 

A method and apparatus for session management and user 
authentication is described. In the following description, numerous specific ' 
details are set forth in order to provide a more thorough description of the 
5 present invention. It will be apparent, however, to one skilled in the art, 
that the present invention may be practiced without these specific details. In 
other instances, well-known features have not been described in detail so as 
not to obscure the invention. 

Overview 

10 Methods and apparatus are described according to one or more 

embodiments of the invention for authenticating a system user and 
management services executing in the system on behalf of the user. In one 
embodiment of the invention, authenticating and session management are 
performed within a system architecture that partitions the computing 

15 functionality between a users HID and a computational service provider 
such as a server. 

Figures 1, 7, and 8 provide examples of system architectures used in 
one or more embodiments of the invention. The present invention can be 
implemented in standard desktop computer systems such as described in 
20 Figure 1, or in any other computer systems, including client - server systems, 
network computers, or the human interface device system of Figures 7 and 
8. 
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Embodiment of Comp uter Execution Environment (Hardware^ 

An embodiment of the invention can be implemented as computer 
software in the form of computer readable code executed on a general 
5 purpose computer such as computer 100 illustrated in Figure 1, or in the 
form of bytecode class files executable within a Java™ runtime environment 
running on such a computer. A keyboard 110 and mouse 111 are coupled to 
a bi-directional system bus 118. The keyboard and mouse are for introducing 
user input to the computer system and communicating that user input to 
10 processor 113. Other suitable input devices may be used in addition to, or in 
place of, the mouse 111 and keyboard 110. I/O (input /output) unit 119 
coupled to bi-directional system bus 118 represents such I/O elements as a 
printer, A/V (audio/video) I/O, etc. 

15 Computer 100 includes a video memory 114, main memory 115 and 

mass storage 112, all coupled to bi-directional system bus 118 along with 
keyboard 110, mouse 111 and processor 113. The mass storage 112 may 
include both fixed and removable media, such as magnetic, optical or 
magnetic optical storage systems or any other available mass storage 

20 technology. Bus 118 may contain, for example, thirty-two address lines for 
addressing video memory 114 or main memory 115. The system bus 118 also 
includes, for example, a 32-bit data bus for transferring data between and 
among the components, such as processor 113, main memory 115, video 
memory 114 and mass storage 112. Alternatively, multiplex data/address 

25 lines may be used instead of separate data and address lines. 
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In one embodiment of the invention, the processor 113 is a 
microprocessor manufactured by Motorola, such as the 680X0 processor or a 
microprocessor manufactured by Intel, such as the 80X86, or Pentium 
processor, or a SPARC™ microprocessor from Sun Microsystems™, Inc. 
However, any other suitable microprocessor or microcomputer may be 
utilized. Main memory 115 is comprised of dynamic random access memory 
(DRAM). Video memory 114 is a dual-ported video random access memory. 
One port of the video memory 114 is coupled to video amplifier 116. The 
video amplifier 116 is used to drive the cathode ray tube (CRT) raster 
monitor 117. Alternatively, video memory 114 could be used to drive a flat 
panel or liquid crystal display (LCD), or any other suitable data presentation 
device. Video amplifier 116 is well known in the art and may be 
implemented by any suitable apparatus. This circuitry converts pixel data 
stored in video memory 114 to a raster signal suitable for use by monitor 117. 
Monitor 117 is a type of monitor suitable for displaying graphic images. 

Computer 100 may also include a communication interface 120 

coupled to bus 118. Communication interface 120 provides a two-way data 

communication coupling via a network link 121 to a local network 122. For 

example, if communication interface 120 is an integrated services digital 

network (ISDN) card or a modem or cable modem, communication interface 

120 provides a data communication connection to the corresponding type of 

telephone line, which comprises part of network link 121. If 

communication interface 120 is a local area network (LAN) card, 

communication interface 120 provides a data communication connection 

8 
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via network link 121 to a compatible LAN. Wireless links are also possible. 
In any such implementation, communication interface 120 sends and 
receives electrical, electromagnetic or optical signals which carry digital data 
streams representing various types of information. 

5 

Network link 121 typically provides data communication through one 
or more networks to other data devices. For example, network link 121 may 
provide a connection through local network 122 to local server computer 123 
or to data equipment operated by an Internet Service Provider (ISP) 124. ISP 

10 124 in turn provides data communication services through the world wide 
packet data communication network now commonly referred to as the 
"Internet" 125. Local network 122 and Internet 125 both use electrical, 
electromagnetic or optical signals which carry digital data streams. The 
signals through the various networks and the signals on network link 121 

15 and through communication interface 120, which carry the digital data to 
and from computer 100, are exemplary forms of carrier waves transporting 
the information. 

Computer 100 can send messages and receive data, including program 
20 code, through the network(s), network link 121, and communication 

interface 120. In the Internet example, remote server computer 126 might 
transmit a requested code for an application program through Internet 125, 
ISP 124, local network 122 and communication interface 120. 
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Tfte received code may be executed by processor 113 as it is received, 
and /or stored in mass storage 112, or other non-volatile storage for later 
execution. In this manner, computer 100 may obtain application code in the 
form of a carrier wave. 

Application code may be embodied in any form of computer program 
product. A computer program product comprises a medium configured to 
store or transport computer readable code, or in which computer readable 
code may be embedded. Some examples of computer program products are 
CD-ROM disks, ROM cards, floppy disks, magnetic tapes, computer hard 
drives, servers on a network, and carrier waves. 

Human Interface Devic e Computer System 

The invention also has application to a computer systems where the 
data to be displayed is provided through a network. The network can be a < 
local area network, a wide area network, the internet, world wide web, or 
any other suitable network configuration. One embodiment of the 
invention is used in computer system configuration referred to herein as a 
human interface device computer system. 

In this system the functionality of the system is partitioned between a 
display and input device, and data sources or services. The display and input 
device is a human interface device (HID). The partitioning of this system is 
such that state and computation functions have been removed from the 
HID and reside on data sources or services. In one embodiment of the 

10 
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invention, one or more services communicate with one or more HIDs 
through some interconnect fabric, such as a network. An example of such a 
system is illustrated in Figure 7. Referring to Figure 7, the system consists of 
computational service providers 700 communicating data through 
interconnect fabric 701 to HIDs 702. 

Computational Service Providers - In the HID system, the 
computational power and state maintenance is found in the service 
providers, or services. The services are not tied to a specific computer, but 
may be distributed over one or more traditional desktop systems such as 
described in connection with Figure 1, or with traditional servers. One 
computer may have one or more services, or a service may be implemented 
by one or more computers. The service provides computation, state, and 
data to the HIDs and the service is under the control of a common authority 
or manager. In Figure 7, the services are found on computers 710, 711, 712, 
713, and 714. 

Examples of services include XI 1 /Unix services, archived video 
services, Windows NT service, Java™ program execution service, and 
others. A service herein is a process that provides output data and responds 
to user requests and input. 

Interconnection Fahrir - In the invention, the interconnection fabric is 
any of multiple suitable communication paths for carrying data between the 
services and the HIDs. In one embodiment the interconnect fabric is a local 
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area network implemented as an Ethernet network. Any other local 
network may also be utilized. The invention also contemplates the use of 
wide area networks, the internet, the world wide web, and others. The 
interconnect fabric may be implemented with a physical medium such as a 
wire or fiber optic cable, or it may be implemented in a wireless 
environment. 

HIDs - The HID is the means by which users access the computational 
services provided by the services. Figure 7 illustrates HIDs 721, 722, and 723. 
A HID consists of a display 726, a keyboard 724, mouse 725, and audio 
speakers 727. The HID includes the electronics need to interface these 
devices to the interconnection fabric and to transmit to and receive data 
from the services. 

A block diagram of the HID is illustrated in Figure 8. The components 
of the HID are coupled internally to a PCI bus 812. A network control block 
802 communicates to the interconnect fabric, such as an ethernet, through 
line 814. An audio codec 803 receives audio data on interface 816 and is 
coupled to block 802. USB data communication is provided on lines 813 to 
USB controller 801. 

An embedded processor 804 may be, for example, a Sparc2ep with 
coupled flash memory 805 and DRAM 806. The USB controller 801, network 
controller 802 and embedded processor 804 are all coupled to the PCI bus 812. 
Also coupled to the PCI 812 is the video controller 809. The video controller 
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809 may be for example, and ATI RagePro+ frame buffer controller that* 
provides SVGA output on line 815. NTSC data is provided in and out of the 
video controller through video decoder 810 and video encoder 811 
respectively. A smartcard interface 808 may also be coupled to the video 
controller 809. 

The computer systems described above are for purposes of example 
only. An embodiment of the invention may be implemented in any type of 
computer system or programming or processing environment. 

In one or more embodiments of the invention, authentication and 
session management components are configured to authenticate users and 
locate and manage sessions. A session is a persistent representation of a ■ 
related set of one or more services executing on behalf of a user. 
Embodiments of the invention authenticate a user and relocate a user's 
session based on the current location of the user without requiring a service 
within a session to be configured to perform user validation and relocation. 
Embodiments of the invention authenticate the user once for all of the 
user s services. Using embodiments of the invention, services are directed 
to the HID (or other terminal device) that a user is currently using. It is not 
necessary for the user to login to each service and establish a new connection 
for a specific HID. 

According to embodiments of the invention, authentication is a 
one-way authentication which improves the manageability and scalability of 

13 
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authentication. There is no need to exchange keys and avoids the need to 
perform key lookups in a central database. 

Figure 2 illustrates authentication and session management 
components and their interactions according to an embodiment of the 
invention. Network terminal 202 is a human interface device (HID) (e.g., 
HIDs 821, 822 and 823). An HID has, as examples of its functions, the task of 
displaying output of services to a user and obtaining input to services from 
the user. Network terminal 202 has the ability to respond to a command 
(e.g., display command) received from, for example, a software program (e.g., 
services 230-238, authentication manager 204 and session manager 206) 
executing on a computational service provider (e.g., computers 710, 711, 712, 
713, and 714). The input received from a user is forwarded to, for example, a 
service that is fulfilling a user request. 

More than one server can execute the services that comprise a session. 
For example, in session 208, service 230 is executing on server 210, services 
232 and 234 are executing on server 212 and services 236 and 238 are 
executing on server 214. 

A user accesses a system (e.g., a server, a session, a service and a 
network terminal) by initiating a login. During login, the user is validated 
by authentication manager 204. Various techniques can be used to allow the 
user to initiate a login. For example, the user can initiate a login by pressing 
a key on network terminal 202. 
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In one embodiment of the invention, a user accesses the system by 
inserting a smart card in a card reader (e.g., card reader 216) attached to 
network terminal 202. A smart card is a card that is capable of storing 
information such as in a magnetic strip or memory of the smart card. The 
5 smart card can store user information such as a user's identification (i.e., 
user ID such as a 64-bit number) and a secret code (e.g., a 128-bit random 
number) that is transmitted to network terminal 202. The secret code is used 
during authentication. 

Network terminal 202 is aware of (or can obtain) its interconnection 
10 network address and the address of authentication manager 204. When a 
user initiates the login, network terminal 202 initiates communication with 
authentication manager 204 to begin authentication. Authentication 
manager 204 is a program active (e.g., executing) on a computational service 
provider connected to network terminal 202 via an interconnection network 
15 such as a local area network (LAN), for example. It should be apparent, 
however, that network terminal 202 can be connected to authentication 
manager 204 using other interconnection network technologies such as a 
fiber channel loop or point-to-point cables. Network terminal 202 sends a 
startup request to authentication manager 204 that includes a user 
20 identification (userlD). 

In one embodiment of the invention, authentication manager 204 
responds to the startup request by initiating an authentication to validate the 
user. Authentication can include any mechanism that verifies the identify 

15 
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of the user to the system. A key or password known only to the user, or 
biometrics information can be used to authenticate the user. 

In an embodiment of the invention, authentication is performed by • 
verifying a personal identification number (PIN) entered by the user at 
network terminal 202. Authentication manager 204 sends a command (i.e., a 
challenge command) to initiate entry of the user's PIN at network terminal 
202. The user entry is packaged by network terminal 202 and transmitted to 
authentication manager 204 (i.e., a challenge response). 

Authentication manager 204 verifies the challenge response with user 
information retained in authentication database 218, information supplied 
by the user and information that is generated during authentication. When 
the user is authenticated, the user is given access to a session (e.g., session 
208). 

If the expected result is received from the user, authentication 
manager 204 notifies session manager 206 (via a connect message) that the 
user has logged into the system on network terminal 202. Session 
information contained in authentication database 218 is used to identifv the 
server, port and session identifier (ID) for session manager 206. Session 
manager 206 is a program that is active on a computational service provider 
and is connected to authentication manager 204 and network terminal 202 
via an interconnection network, for example. Authentication manager 204 
sends a message to session manager 206 using session manager 206's server 
and port information contained in authentication database 218. 
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In response to the connect message from authentication manager 204, 
session manager 206 notifies the services in the user's current session (i.e., 
the services in session 208) that the user is attached to network terminal 202. 
That is, session manager 206 sends a connect message to services 230-238 to 
direct output to network terminal 202. Session manager 206 ensures that 
services that are considered to be required services of the session are 
executing. If not, session manager 206 causes them to be initiated. The user 
can interact with services 230-238 within a session (e.g., session 208). 
Network terminal 202 is connected to servers 210, 212 and 214 (and services 
230-238) via an interconnection network such as a local area network or 
other interconnection technology. The user can also start new services or 
terminate existing services. 

The user can detach from the system by removing the card from card 
reader 216. Other mechanisms to express a disconnect can also be used with 
the invention (e.g., a "sign-off button on network terminal 202). Services 
230-238 can continue to run even after the user removes the card from card 
reader 216. That is, a user's associated session(s) and the services that 
comprise a session can continue in existence during the period that a user is 
unattached (e.g., logged off ) from the system. When the user removes the 
card from card reader 216, network terminal 202 notifies authentication 
manager 204 (e.g., via a disconnect message) which notifies session manager 
206 (e.g., via a disconnect message). Session manager 206 notifies services 
230-238 (e.g., via a disconnect message) which terminate their transmission 
of display commands to network terminal 202. Services 230-238 continue 
execution, however, during the time that the user is not logged onto a 
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network terminal. The user can log back in using a network terminal such 
as network terminal 202, connect to session 208 and interact with services 
230-238. 

While Figure 2 depicts a single instance of each, it should be apparent 
that there can be multiple instances of network terminal 202, authentication 
manager 204, session 208. For example, there can be more than one instance 
of authentication manager 204 servicing network terminal 202 or multiple 
instances of network terminal 202. Authentication manager 204 instances 
can be organized in a hierarchy according to the topology of the network or 
they can be globally available, for example. 

Having more than one instance of the authentication manager 
improves the scalability of the system since it is possible to add (or remove) 
instances of authentication manager 204 based on the current load (e.g., the 
number of users). Further, reliability is improved since redundant instances 
of authentication manager 204 can be deployed. 

Similarly, there can be a multiplicity of session manager 206 instances. 
Like authentication manager 204, multiple instances of session manager 206 
can increase the scalability and reliability of the system. 

Session Manag er 

Session manager 206 maintains session database 220 that contains 
mappings between users, sessions, and services. Session manager 206 
manages the services that comprise each session managed by session 
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manager 206. For example, session manager 206 maintains session 208 and 
services 230-238 within session 208. 

To access a computational service provider, an account is first set up 
or enabled for a user. For example, to enable a user according to one 
5 embodiment of the invention, the user is given a userlD, a PIN and a smart 
card that stores the userlD and secret code. In addition, a session is created 
for the user. As described below, a session can have none or more required 
services. It may be necessary to initiate some of the required services when 
the session is created. Once a service is initiated, it continues to be active 
10 regardless of whether the user is connected to the system. The balance of 
required services can be initiated when the user first logs in. 

A user is not limited to one session. There can be multiple sessions 
associated with a user at any given time. Session database 220 contains 
records that identify the session(s) and service(s) within a session that are 
15 associated with a user. An enabled user can be removed from the system. 
When a user is removed from the system, all of the user's associated 
sessions are removed from the system and from session database 220. 
Services associated with the users sessions are stopped as well. 

Once a user is enabled to use a system, the user can log onto the 
20 system via network terminal 202. When session manager 206 is notified by 
authentication manager 204 that the user is connected to network terminal 
202, session manager 206 notifies the user's session (i.e., the services that 
comprise a session). Session manager 206 consults session database 220 to 
identify and notify the session's services. For example, session database 220 
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includes information that identifies session 208 and services 230-238 that are 
included in session 208. 

Session database 220 contains permanent session records and dynamic 
session records that identify sessions and the services associated with a 
5 session. Session database 220 can be one or more databases or data stores. 
For example, permanent session records can be stored in a configuration file 
while dynamic session records can be stored in memory in a database system. 
A permanent session record contains configuration information for a user 
and is typically created for a user at the time the user is enabled to use the 
10 system, for example. A dynamic session record identifies those services that 
are associated with a user. Dynamic session records identify the required 
services that are associated with a user session in a permanent session record 
as well as currently active services. The following contains a format for a 
permanent session record according to an embodiment of the invention: 

15 sessionID servicelD serviceHost servicePort isLazy 

The sessionID field uniquely identifies the session that contains the 
required service(s). The servicelD field uniquely identifies, a service 
associated with the session identified by sessionID. The serviceHost and 
servicePort fields identify the server on which a service is running and the 
20 port on the server by which a service can receive communications. The 
isLazy field identifies the manner in which a service is initiated. For 
example, isLazy can specify that the service is to be started immediately upon 
the creation of a session, or that the service is to be started when the user 
first accesses the system. There may be multiple occurrences of the 

20 
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servicelD, serviceHost, servicePort and isLazy fields each occurrence 
identifying a required service associated with the session identified by 
sessionlD. 

The dynamic session record identifies the required services for the 
5 session and those services that are currently executing in the session. A 
session's required services are retrieved from the permanent session record, 
for example. A dynamic session record can identify zero or more services 
(required or otherwise) that are currently executing on behalf of a user. 

The fields that are used to store information about a service in a 
10 dynamic session record depends on whether the service is a required service 
or a service. A required service that is currently active is also a current 
service. The format of a dynamic session record that identifies a sessions 
required services is the same as the permanent session record format. The 
following identifies the format for a record associated with a currently 
15 executing service according to an embodiment of the invention: 

sessionLink TCPSocketfd requiredServiceLink servicelD 

The sessionLink field identifies the service's session. An open 
connection, or pipe, is established between session manager 206 and a 
currently executing service in a session. The open connection can be used to 
20 notify either session manager 206 or the service that the other has 

abnormally, or otherwise, terminated. In one embodiment of the invention, 
the open connection is a TCP socket connection which is identified by the 
TCPSocketfd field. However, it should be apparent that any form of reliable 
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connection technology that could provide a notification that a connection is 
disabled or disappears could be used with embodiments of the invention. 

The service has an identifier that is stored in the servicelD field. A 
currently running service can be linked to a required service. A link to a 
required service is identified by the requiredServiceLink. If there is no link 
to a required service, the requiredServiceLink is null. 

The dynamic session record can also be used to store information 
about a connection to a network terminal (e.g., network terminal 202). The 
following contains the fields that identify the connection according to an 
embodiment of the invention: 

sessionLink Status IPAddress 

Multiple sessions can be associated with a user. The sessionLink field 
identifies the session to which the user attached to network terminal 202 is 
currently linked. The sessionLink can have as its value the sessionID value, 
for example. The status field identifies the connection status (i.e., connected 
or disconnected) of network terminal 202 to the session. The IPAddress field 
contains the interconnection network address of network terminal 202. An 
IP address is used in one or more embodiments of the invention. However, 
it should be apparent that alternative interconnection technologies may use 
alternate addressing schemes. For example, an asynchronous transfer mode 
(ATM) network might use a thirteen digit switch prefix/end point identifier. 

This information can be used by session manager 206 to send a status 
message to network terminal 202. If network terminal 202 does not respond 
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within a certain period of time, session manager 206 assumes that network 
terminal 202 is no longer in use by the user and sends a disconnect message 
to each of the services in the session. 

Other information of which session manager 206 is aware include a 
5 list of the open connections (e.g., services having an open TCPsocketfd) to 
services and a mapping between open connections and sessions and the 
services within a session. This information can be compiled from the 
session records, for example. 

The information available to session manager 206 can be used to 
10 locate a session. For example, given a service, it is possible to find a session 
that contains the service and /or the services that are contained within a 
session. Further, it is possible to locate a session that is associated with a 
given user or instance of network terminal 202 whether or not it is currently 
executing, for example. 

15 Service Initiation 

When session manager 206 receives a message from authentication 
manager 204 that a user is connected to network terminal 202, session 
manager 206 initiates those required services that are not currently active. 
Session manager 206 further notifies the currently active services to direct 
20 input/output (I/O) to network terminal 202. I/O can be expressed using a 
command protocol used to communicate with network terminal 202 and its 
peripheral devices. (Appendix A contains an example of a command 
protocol according to an embodiment of the invention.) 
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To initiate a service, session manager 206 accesses the server on which 
the service is to execute to start the service. For example, session manager 
206 sends a request to a well-known port on the server and passes the 
sessionHost, sessionPort and sessionID for session manager 206. The server 
connects to network terminal 202 that is attached to the service and uses the 
server's native authentication and permissions to allow the user to access 
the server. For example, in a UNIX operating environment, a UNIX service 
could start with a "CDE Login" screen displayed at network terminal 202 to 
authenticate the user and ensure that the user wishes to connect to the 
service. 

For session manager 206 to start a service on a server, it is given the 
privileges needed to start the service. It may be undesirable to give session 
manager 206 these privileges. Further, in current networking 
environments, servers may be running different operating environments. 
In this case, session manager 206 must be aware of each operating 
environment's procedures for initiating a service. 

Alternatively, a session-aware application running on the server can 
perform the initiation and register the service with session manager 206. In 
this case, it is not necessary for session manager 206 to have the needed 
privileges. Further, session manger 206 does not have to implement a 
centralized model for initiating services on multiple operating 
environments. The responsibility for initiating services is left to the 
session-aware applications that are running in the different operating 
environments. A session-aware server application has knowledge of session 
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manager 206 (e.g., has the sessionID, sessionHost and sessionPort of session 
manager 206) and its interfaces (e.g., message formats). 

The session-aware server application can initiate a service in response 
to a request received from session manager 206. Session manager 206 sends 
an initiate message to the server application that possesses the permission to 
start services in the server's operating environment. The server application 
initiates the service for session manager 206 and responds to session 
manager 206 with a valid sessionID. On the UNIX and NT systems, for 
example, the sessionID can be made available in the operating environment. 
Services such as video windows might start in this manner, for example. 

Alternatively, the session-aware application can contact a service to 
obtain its permission in the form of a cryptographically signed 
authorization. The server application can transmit the sessionID and the 
signed authorization to session manager 206. If the session-aware 
application contacts session manger 206 without an authorization but with a 
description of the service, session manager 206 could request approval from 
network terminal 202 to ensure that the user authorized the service. If the 
user responds affirmatively, the service is added to the session. 

Session Manager Messages 

Session manager 206 receives and generates messages to manage the 
services within a session. Techniques other than those described herein can 
be used for initiating services. If session manager 206 initiates a service, it 
sends an initiate message to the server (or session-aware server application). 
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Session manager 206 can generate an initiate message to start required • 
services identified in session database 220, for example. As another example, 
session manager 206 can send an initiate message to re-activate a required 
service that it has determined (e.g., via an open TCP connection between 
5 session manager 206 and the service) has terminated. 

Session manager 206 receives a connect message when a user of 
network terminal 202 successfully attaches to the system. In response to the 
connect message, session manager 206 verifies that all of the required 
services are started, and starts those that are not running. Session manager 
10 206 sends a message (e.g., a connect message) to the services in the session to 
direct I/O to network terminal 206. 

When a disconnect message is received, session manager 206 sends a 
disconnect message to each one of the services in the session directing them 
to terminate sending I/O to network terminal 202. 

15 Session manager 206 can send status messages to network terminal 

206 periodically to ensure that network terminal 202 is still connected. For 
example, session manager 206 can examine session database 220's dynamic 
session records to identify each session that is currently connected to a 
network terminal. That is, session manager 206 can examine the status field 

20 associated with a network terminal in a dynamic session record in session 
database 220. Session manager 206 sends a status request (e.g., a "ping") to 
each network terminal that is connected with a session. If an answer is not 
received from network terminal 202 within a certain period of time (e.g., 20 
seconds) for a particular session, session manager 206 assumes that the 
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session is disabled and it sends a disconnect message to each service in the 
session instructing them to terminate display functions. 

Network terminal 202 responds to the status (e.g., ping) request from 
session manager 206 with either a "Card In" or "Card Out" status. If a "Card 
Out" status is received from network terminal 202, session manager 206 
sends a disconnect message to each of the session's services. 

If the "Card In" status is sent in response to a status request, network 
terminal 202 also indicates the number of insertions of the card in card 
reader 216, the number of seconds since a card insertion, and the cardlD. The 
cardID is, for example, the value of sessionID for the user's session. Session 
manager 206 retains at least the last status information received from 
network terminal 202 to compare the new status information against the 
previous status information. If, for example, the number of insertions or 
the number of seconds for insertion differs from the last status information, 
session manager 206 considers the session to be disabled. In this case, session 
manager 206 sends a disconnect message to the session's services. 

When a service is started by, for example, a session-aware server 
application, a service connect message is sent to session manager 206. If the 
service has the proper authorization, session manager 206 adds the service to 
the list of services for the session and sends a message to the service to direct 
I/O to network terminal 202. 
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Authentication Manag er 

The authentication manager is responsible for ensuring the legitimacy 
of a user and associating a user with a session(s). During the initialization 
process (which is described in more detail below), an authentication 
5 exchange takes place to authenticate the user in one embodiment of the 
invention. Authentication can be include any mechanism that verifies the 
identify of the user to the system. For example, a key password can be 
entered or biometrics data can be collected to authenticate the user. 

Authentication database 218 contains user and session information 
10 that can be accessed by authentication manager 204. In one embodiment of 
the invention, the format of a record contained in authentication database 
. 218 is as follows: 

userlD secret PIN sessionHost sessionPort sessionID 

The userlD and secret fields contain the same values as those stored in 
15 a user s smart card. The userlD and secret values are typically established 
when the user is enabled to use the system, for example. In one 
embodiment of the invention, the secret field contains a 128-bit value. The 
PIN field is the personal identification number (PIN) that is known to the 
user and requested by authentication manager 204 during authentication. 
20 The userlD, secret and PIN values are used to authenticate a user. 

Authentication database 218 could contain other information such as a 
password or biometrics data, if they were used to authenticate a user. 
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The sessionHost field identifies the computational service provider 
(e.g., a server) that is executing session manager 206 that is managing the 
user's current session. The sessionPort field identifies the port for 
communicating with session manager 206. The sessionID field contains a 
5 unique identifier for session manager 206. If authentication is successful, the 
sessionHost, sessionPort and sessionID fields are used to notify session 
manager 206 of the user's location at the network terminal 202. 

In an embodiment of the invention, a challenge mechanism is used 
to authenticate a user. (Figure 6 provides a challenge process flow according 
10 to an embodiment of the invention.) Authentication manager 204 sends a 
challenge to network terminal 202 to verify the authenticity of the user. 
Network terminal 202 prepares the challenge response, and returns it to 
authentication manager 204. If the response to the challenge is as expected, 
the user is verified to authentication manager 204. 

15 Figures 5A-AB provide an authentication process flow according to an 

embodiment of the invention. The authentication process can be repeated 
more than once until authentication is successful or the number of 
repetitions, or rounds, exceeds a certain number. At step 502, an identifier 
that represents the number of the authentication round is initialized to zero. 

20 At step 504, a random number is generated that is used as the challenge 
number. At step 506, authentication manager 204 sends an 
N_AUTHENTICATE command to network terminal 202 as well as a packet 
of information for the authentication process. 



29 



WO 02/37267 



PCTAJS01/48678 



In one embodiment of the invention, the following information is 
sent in conjunction with the N_AUTHENTICATE command: 

code identifier length valueSize value 

The code field identifies the type of information contained in the 
information packet. For example, a value of M 1 M indicates that the 
information packet contains a challenge. The identifier field contains the 
value (i.e., the round indicator) that was generated at step 502. The length 
field identifies the length of the information packet. The value field 
contains the random number, or value of the challenge, generated in step 
504. The valueSize identifies the size of the value field (e.g., 128 bits). 

At step 508, authentication manager 204 sends rendering commands 
to network terminal 202 prompting the user for the user's PIN. At step 510, 
authentication manager 204 waits for a response from network terminal 202 
or a timeout. 

If a timeout is detected at step 510, processing continues at step 514 to 
determine whether the maximum number of rounds has been exceeded. If 
not, processing continues at step 518 to increment the identifier and 
processing continues at step 504 to begin a new authentication round. If it is 
determined, at step 514, that the maximum number of rounds has occurred, 
processing continues at step 516 wherein authentication manager 204 sends 
rendering commands to network terminal 202 indicating a failure and the 
authentication process ends. Rendering commands can be, for example, part 
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of a command protocol used to communicate with network terminal 202 
and its peripheral devices. 

A challenge routine includes commands sent by authentication 
manager 204 to network terminal 202 to capture the PIN entry by the user 
5 and generates a response. Network terminal 202 generates a response value 
that is the output of a hash function (i.e., a hash value or challenge 
response) from an input including the user's PIN, the value of the identifier, 
the value of the secret stored in the user's smart card and the value of the 
challenge (e.g., the random number generated in step 504). 

10 A hash function can take variable-length input and convert .it to a 

fixed-length output (a hash value). One example of a hash function takes 
the input and returns a byte consisting of the exclusive-or (XOR) of all the 
input bytes. There are many other examples of hash functions that can used 
with embodiments of the invention. The hmac_md5 function (RFC2104) is 

15 one example of a hashing function that is used in an embodiment of the 
invention to generate a response. 

The following packet format is used by network terminal 202 to send 
the response to authentication manager 204 according to one embodiment of 
the invention: 

20 code identifier length valueSize value userlD 

The code field is set to a value of "2" which indicates that the 
information packet contains a challenge response. The value field contains 
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the challenge response (e.g., the result of a hashing function). The userlD 
field contains the user's userlD. 

If authentication manager 204 determines (at step 510) that it received 
a response from network terminal 202, processing continues at step 512 to 
5 determine whether the identifier returned by network terminal 202 matches 
the identifier generated by authentication manager 204. If so, processing 
continues at step 520 to examine the response returned by network terminal 
202. 

At step 520, authentication manager 204 determines whether the 
10 challenge response matches the response expected by authentication 

manager 204. For example, authentication manager 204 can generate a hash 
value using its identifier, PIN, secret and challenge values. If the hash value 
generated by authentication manager 204 matches the challenge response 
generated by network terminal 202, authentication is partially successful. 
15 Authentication manager also verifies that the interconnection network 
address of network terminal 202 and the user's userlD are valid. If the 
challenge response, interconnection network address and userlD are 
verified, authentication is successful. If not, authentication failed. 

If authentication is successful, processing continues at step 528 to send 
20 an N_AUTHENTICATE command. The format of the command, according 
to an embodiment of the invention, is as follows: 

code identifier length 
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The code field contains a value of "3" to indicate that the user was 
successfully authenticated. Processing continues at step 530 to send 
rendering commands to network terminal 202 indicating that session 
manager 206 is connecting the user to one of the user's sessions. At step 532, 

5 authentication manager 204 notifies session manager 206 that the user is 
connected to the system via network terminal 202. Authentication manager 
204 sends the interconnection network address of network terminal 202 and 
session manager 206's sessionID to the server that is executing session 
manager 206 (i.e., the server identified in the sessionHost field of the users 

10 authentication database record) at step 532. 

If authentication failed, processing continues at step 522 to send an 
N_ AUTHENTICATE command. Like a successful authentication, the 
N_AUTHENTICATE command includes a code field that indicates the 
status of the authentication process. A code value of "4" is used, for example 
1? to indicate that authentication failed. Processing continues at step 524 to 
send rendering commands to network terminal 202 indicating that the 
authentication failed and instructing the user to remove the smart card from 
card reader 216. 

The authentication process ends at step 526. 

20 The process described with reference to Figures 5A-5B is one example 

or an authentication process. It should be apparent that other authentication 
techniques can be used with embodiments of the invention. In an alternate 
embodiment the user is not requested to enter a PIN. The users card in card 
reader 216 is enough to authenticate the user. The userlD and secret value 
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can be hashed with the identifier and the challenge received from 
authentication manager 204 to generate a response to a challenge by . 
authentication manager 204. In this way, a user can attach to the user's 
services simply by inserting a card containing valid information into card 
5 reader 202. 

Further, it should be apparent that embodiments of the invention can 
be used wherein no authentication of a user is performed. For example, in a 
trusted or secure environment there may be no need to verify the 
authenticity of a user. Therefore, in one embodiment of the invention, a 
10 user is connected to a session without first being authenticated by 

authentication manager 204. The user need only provide an identification 
(e.g., userlD), for example. If the user provides a valid userid, the user is 
given access to the session that is associated with the userlD. 

When the user disconnects from network terminal 202, 
15 authentication manager 204 is informed and informs session manager 206 of 
the disconnection. For example, when the user removes the smart card 
from card reader 216, card reader 216 informs network terminal 202. 
Network terminal 202 informs authentication manager of the 
disconnection. Authentication manager 204 informs session manager 206 
20 that the user has disconnected from network terminal 202. Session manager 
206 notifies each of the services in the user's session. 
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Challenge Routine 

The authentication process can include a challenge initiated by 
authentication manager 204. Figure 6 provides a challenge routine process 
flow for handling a challenge according to an embodiment of the invention. 
5 The challenge routine executes on network terminal 202 in response to a 
challenge command received from authentication manager 204. 

At step 602, the key entry received from the user is read until a return 
or enter key is pressed. The key entry is translated to ASCII characters at step 
604. At step 606, a hash function is used to generate a hash value, or 
10 challenge response, from the concatenation of the identifier, PIN, secret, and 
challenge values. The challenge response is sent to authentication manager 
204 at step 608. At step 610, network terminal 202 awaits a response from 
authentication manager 204 or a timeout. If a response or a timeout occurs, 
the challenge routine ends at step 614. 

15 Network Terminal Initialization 

Network terminal 202 performs some initialization when it is first 
turned on. While a user is not using network terminal 202, network 
terminal 202 can be in a dormant state if it is powered on. A user can 
awaken network terminal 202 from its dormant state using one of the 
20 techniques described herein, for example. It should be apparent that other 
techniques can be used to awaken network terminal. 

Figure 3 provides a process flow for initializing network terminal 202 
in response to a power up operation according to an embodiment of the 
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invention. At step 302, a determination is made whether a power up 
operation has occurred. If not, processing continues to wait for a power up 
operation. At step 304, a request is generated by network terminal 202 to the 
network to test the network connection. At step 306, a determination is 
made whether a response is received. If not, processing continues at step 310 
to generate an error and processing continues at step 302 to await a power up 
operation. 

If it is determined, at step 306, that an answer is received, processing 
continues at step 308 to send an acknowledge (an ACK) message and 
initialization of network terminal 202 can continue at step 402 of Figure 4A. 

Figures 4A-4C provide a process flow according to an embodiment of 
the invention for initializing network terminal 202 in response to an 
awaken operation. Referring to Figure 4A, network terminal 202 waits for 
notification of the awaken operation. In an embodiment of the invention, 
the awaken operation is the insertion of a user's smart card in card reader 
216. 

If it is determined that a smart card is inserted in card reader 216, 
processing continues at step 404 to send a request to obtain the 
interconnection network addresses of authentication manager 204 and 
network terminal 202. Alternatively, a user's smart card can be 
preprogrammed with the interconnection network addresses. Network 
terminal 202 can read the interconnection network addresses from the- smart 
card via card reader 216, for example. 
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At step 406, network terminal 202 awaits a response or a timeout. If a 
timeout occurs, processing continues at step 412 to determine whether the. 
maximum number of tries has been exceeded. If the maximum number of 
tries has been exceeded, processing continues at step 410 to generate an error. 
5 If the maximum number of tries has not been exceeded, processing 
continues at step 414 to increment the number of tries and processing 
continues at step 404 to resend the request for the interconnection network 
addresses. 

When a response to the request is received, processing continues at 
10 step 408 to send an ACK. Processing continues at step 416 of Figure 4B. At 
step 416, network terminal 202 sends a startup request to authentication 
manager 204. At step 418, a retry time is set in which network terminal 202 
waits for a response to the startup request. At step 420, a variable is set to 
indicate that network terminal 202 is waiting for a response to the startup 
15 request. At step 422, network terminal 202 waits for a response to the startup 
request. 

If it is determined that a response is not received, processing 
continues at step 424 to determine whether the retry time as been exceeded. 
If not, processing continues at step 422 to wait for a response. If the retry 
20 time has been exceeded, processing continues at step 426 to determine 

whether the maximum number of tries has been exceeded. If not, processing 
continues at step 428 to generate an error and return to step 416 to resend the 
startup request. If not, processing continues at step 430 to increment the 
number of tries and reset the retry time. At step 432, the startup request is 
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resent and processing continues at step 444 to determine whether the card 
has been removed from card reader 216. 

If it is determined, at step 422, that a response was received, processing 
continues at step 434 of Figure 4C At step 434, network terminal 202 

5 examines the variable initially set in step 420 to determine whether it is 
waiting for a response to the startup request. If so, processing continues at 
step 436 to determine whether the response is a challenge message. If not, 
processing continues at step 424 to repeat the startup request if the 
maximum number of tries has not been exceeded. If it is determined, at step 

10 436, that a challenge message has been received, processing continues at step 
438 to set the waiting_for_startup variable is set to.no (i.e., "N"). Processing 
continues at step 440 to process the challenge request at steps 440 and 442. - 
The challenge request can be handled as described above with reference to 
Figures 5A-5B and 6, for example. 

15 If it is determined, at step 434, that network terminal 202 is not 

waiting for a response to a startup request, processing continues at steps 440 
and 442 to handle the message (e.g., rendering commands to display output 
generated by service 234). 

At step 444, a determination is made whether the user has removed 
20 the smart card from card reader 216. When the user removes the card from 
card reader 216, network terminal 202 sends a disconnect message to 
authentication manager 204 at step 448. Network terminal 202 waits for an 
acknowledgment (ACK) message from authentication manager 204. When 
the ACK message is received, network terminal 202 clears the screen, at step 
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450, and returns to step 402 to wait for another user to insert a smart card in 
card reader 216. 

If it is determined, at step 444, that the user has not removed the card 
from card reader 216, processing continues at step 446 to determine whether 
5 network terminal is waiting for a response to its startup request. If so, 

processing continues at step 422 to determine whether a response has been 
received. If network terminal is not waiting for a response from a startup 
request, processing continues at steps 440 and 442 to process any messages 
sent to network terminal 202. 

10 Message Format 

In an embodiment of the invention, a connection to network 
terminal 202 is established via a user datagram protocol (UDP) port. That is, 
packets are sent via a UDP connection and received at a destination UDP 
port. The destination UDP port uniquely identifies the connection. Packet 
15 length and checksum information are provided by the UDP header. Buffer 
size fits in an Ethernet Maximum Transfer Unit (MTU) with IP/UDP 
headers. Data is sent over the network in network byte order (big-endian). 

It should be apparent that other protocols can be used in place of UDP. 
For example, protocols such as an ATM AAL5 (AAL or ATM Adaptation 
20 Layer) can be used. 

Thus, a method and apparatus for session management and user 
authentication has been described. Particular embodiments described herein 
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are illustrative only and should not limit the present invention thereby. 
The invention is defined by the claims and their full scope of equivalents. 
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APPENDIX A 
Command Protocol Examp le 



Rendering Commands 
Wire Protocol Command Formats 

All data is sent over the network in network byte order 
(big-endian) and bit-fields are packed from MSB to LSB. 

The basic rendering command format is: 

<COMMAND:8> < SEQUENCE : 24> <X:16> <Y:16> <WIDTH:16> <HEIGHT:16> <Info> 



COMMAND 



Code <Info> Description 



Set 

Fill 
Glyph 



Copy 
Bilevel 



Set24 



OxAl WIDTH*HEIGBT of 32-bit values <X,B,G,R> 
[WIDTH*HEIGHT <- 512 pixels] 

0xA2 one 32-bit value <X,B,G,R> 

0xA3 one 32-bit value <X f B,G,R>, 
(HEIGHT * ceiling (WIDTH/ 8)) 
bytes of bitmap [i.e. each line 
padded to 8 bits] [WIDTH* HEIGHT 
<= 2048 pixels]; the entire 
command is padded to the next 
3 2 -bit boundary 

0xA4 <FROMJC:16> <FROM_Y:16> 

0xA5 two 32-bit values cO, and cl, 
<X,B,G,R>/ followed by 
(HEIGHT * ceiling (WIDTH/8 ) ) 
bytes of bitmap (i.e. each line 
padded to 8 bits] [WIDTH*HEIGHT 
<= 2048 pixels]; the entire 
command is padded to the next 
32-bit boundary 

0xA6 WIDTH* HEIGHT of packed 24-bit 
values <B,G,R> [WIDTH-HEIGHT 
<» 512 pixels] padded to the 
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APPENDIX A fConHmiPH) 



next 32-bit boundary 



Set YUV Image 0xA7 



<SOURCE_W : 1 6> <SOURCE_H : 1 6> 
<RFU:8> <LUMA ENCODING: 2> 
< CHROMA SUB X?3> <CHROMA_SUB_Y : 3> 
followed by~(SOURCE_W • SOURCE_H) 
pixels Y [luma] with each line 
padded to a byte boundary, and 
(ceiling (SOURCE_W / x subsaraple) 
* ceiling (SOURCE_H / y_subsample) ) 
bytes each of 8-bit signed U 
and V [chroma] in CCIR-601 value 
encodings; the entire command 
is oadded to the next 32-bit 
boundary; [SOURCE_W * SOURCE H 
<= 1024 pixels); [S0URCE_W <= 
WIDTH]; [SOURCE H <=* HEIGHT] 



Set Cursor 0xA9 two .32-bit values cO, and el, • 

<X,B,G,R>, followed by two sets 
of (HEIGHT * ceiling (WIDTH/8)) 
bytes of bitmap [i.e. each line 
padded to 8 bits] [WIDTH & HEIGHT 
<= 64 pixels each] . The first 
bitmap is the pixel values , the 
second is the per-pixel mask. The 
entire command is padded to the 
next 32-bit boundary. 



Set Pointer OxAA 



<INDEX:8> <DIM:2> <PAD:6> 

{ <Z:16> { <P:16> <R:16> <B:16> 

<PAD:16> } } I <PAD:16> 



Set Key Locks OxAB 



note that all values are signed, 2's 
compliment. Angular values range from 
-180 to +180- (1 lsb) -+179.9945 (degrees 
over full range. 

WIDTH, HEIGHT are ignored. 

X, Y, WIDTH, HEIGHT ignored. 
< INDEX :8> <LOCKS:8> <PAD:16> 



Damage Repair OxAC <EPOCH:32> <PAD:8> <SEQ:24> 



Play Audio OxBl x, Y, WIDTH, HEIGHT are encoded as 

follows: 

X:4 audio sequence number 
X:12 interleave offset 

Y total sequence length- 1 

WIDTH: 4 mixer mode 

specifies the # of channels 
to include in the standard mix. 
Channel numbers above this 
number are sent raw and not 
combined with any other channel 



42 



WO 02/37267 



PCT/US01/48678 



APP5NPIX A (C o ntinue d ) 



if the terminal has insufficent 
channels to cover the request. 

WIDTH: 12 packet len in samples 
max 2000 bytes 

HEIGHT: 4 number of channels-1 
HEIGHT: 12 interleave size-1 

The header is followed by the 
specified number of samples x 
number of channels x 16 bits. 

The entire command is padded to 32 bits 

The sequence number is incremented for each command. 
Sequence numbers may not be all zero except for a epoch 
changing flush command, described below. Rectangles may 
not wrap. I.e. x+width < 0x10000 and y+height < 0x10000. 

One additional informational command is defined with a different 
format : 

<COMMAND:8> <SEQUENCE : 24> <EPOCH:32> <FILL:16 * 8> 
COMMAND Code 



Flush OxAF 

The sequence number of a flush command is the same as the 
sequence number of the previous command, with the exception 
of epoch changes (see description below) . That is, sequence 
numbers only increment when pixels change or the epoch 
changes . 



Command Descriptions 



Command Description 



Set Set the rectangle defined by <x f y> 

<width, height> to the pixel values 
that follow. There is one pixel value 
for each pixel in the region. The 
layout is by rows; i.e. there are "width" 
pixel values for pixels at <x, y> through 
<x+width-l, y> followed by pixels at 
<x, y+l> through <x+width-l, y+l>, etc. 
<0,0> describes the upper left corner. 

Fill Set all pixels in the rectangle defined by 

<x, y> <width, height> to the single 
32-bit value. 

Glyph The 32-bit value is placed in the pixel 

location corresponding with 'each one 
bit in the bitmap, positions associated 
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with zero bits are unchanged. The 
bitmap is laid out by rows (y, y+1, . ..)/ 
using MSB to I*SB in each byte. 

Copy Copy the rectangle defined by 

<from_x, from_y> <width, height> to the 
rectangle defined by <x, y> <width, height>. 
The client must ensure overlapping 
regions are copied correctly (e.g. see 
Solaris bstring(3) ) . 

Bilevel The two 32-bit values cO and cl, are 

placed in the pixel location 
corresponding with each zero and one 
bit, respectively, in the bitmap. The 
bitmap is laid out by rows 
(yr y+l# •••)> using MSB to LSB in 
each byte. 

Set24 Set the rectangle defined by <x, y> 

<width, height> to the pixel values 
that follow. The pixel values are 
packed such that there are four pixels 
defined by three 32-bit values thusly: 
<bgrb,grbg,rbgr>. If width is not a 
multiple of four, the end is packed the 
same as above with the remaining values 
and padded to the nearest 32-bit value. 
There is one pixel value for each pixel 
in the region. The layout is by rows; 
i.e. there are "width" pixel values for 
pixels at <x, y> through <x+width-l, 
y> in ((3 * width +3) / 4) 32-bit words 
followed by pixels at <x, y+l> through 
<x+width-l, y+l>, etc. <0,0> describes 
the upper left corner. 

Set YUV Image Set the rectangle defined by <x, y> 
<width p height> to the pixel values 
provided as follows. The image in 
CCIR/ITU.BT-601 Y' CbCr (or YUV) format of 
source_w by source_h pixels is decoded 
to RGB. The chroma elements may be 
subsampled in the horizontal and/or 
vertical dimensions as specified and must be 
up-sampled prior to the transformation. 

The values of CHROMA_SUBJC and CHROMA_SUB_Y 
(x^subsample and y_subsample, respectively) 
are encoded as follows: 

0 - No chroma values; monochrome image. 

1 - Subsanple by .1. (i.e. no subsample) 

2 - Subsample by 2 

3 - Subsample by 4 

4-7 - Undefined/reserved 

LUMA_ENCODING values are: 

0 - Y (luma) is specified by 8-bit 

unsigned data 

1 - Y (luma) consists of 4-bit 

quantized DPCM values (see 
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below) . 
2,3 - Undefined/reserved 

RFU is reserved for future use and must be 0. 

After decoding, the RGB image is scaled up 
as necessary to width by height pixels. 
The resulting image is put on the 
display at location <x, y>. 

Note: if both CHROMA_SUB_X and CHROMA_SUB_Y 
are zero, the image is monochrome (luma 
only) and no U or V data is present. It is 
invalid to have one set to zero and the 
other non-zero. 

The comoonent order is Y (or CCIR-601 Y' ) , 
U (CCIR-601 Cb), and then V (CCUR-601 Cr) . 

Set Cursor This command sets the appearance of the 

local display cursor (moved and reported 
by Pointer [0]). The cursor is a maximum 
of a 64x64 block, but may be any size 
less than that. If the mask value for 
a particular pixel is '1' , the 
corresponding cursor pixel is displayed; 
if the mask is ' 0' , the cursor is 
transparent at that location. When the 
mask is '1', the pixel value is 'c0' 
when the value is '0', and 'cl' when 
the value is 'V . If the mask is zero, 
the pixel value should also be zero. A 
mask of zero and a pixel value of one 
is reserved for future expansion. 

WIDTH and HEIGHT may be zero, indicating 
not to draw a cursor (equivalent to a 
mask of all zeros) . Pointer tracking 
continues to work normally. 

X and Y denote the 'hot spot' for the 
cursor? e.g., on what pixel of the 
cursor image events are to be reported. 
This is primarily used for stopping the 
cursor on the edges of the display. X 
[0, WIDTH), Y [0, HEIGHT). 

Set Pointer Sets the location of a pointer. 

Pointer (0 J is usually settable (mouse 
or touchscreen) and is the 2-D screen 
cursor. This command is provided for 
applications that insist on setting 
their pointer, or for applications that 
need relative pointers (e.g. reset the 
cursor to its previous position) . As 
such, there are a few restrictions: 

. setting the pointer may not work 
(e.g. a joystick) at all 

. the pointer value may be clipped 
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arbitrarily to match the pointer 
device or the screen 

. the user can continue to move the 
pointer once it is set, but that 
is reported using a 'Pointer State' 
status message. 

. the behavior of resetting the pointer 
for pseudo-relative mode could cause 
different behaviors with different 
devices; e.g. a touch screen, is 
only settable when the user is not 
' dragging' . 

Pointers are allowed to have up to six 
dimensions. The number of dimensions 
and the size of the command are set 
using the DIM bits. All pointer values 
are signed, 2's compliment. 

Set Key Locks This command sets the lock values for an 
<INDEX>'ed keyboard. Locks generally 
correspond to lights on the keyboard 
that are software controllable. If a 
lock condition is to be indicated, then 
the bit should be set in the mask, 
otherwise, the bit should be cleared.- 
Since some keyboards may implement locks 
locally (e.g. mechanically), setting a 
lock may not have an affect. Keys from 
the keyboard should always be interpreted 
from the state reported by the keyboard. 
On the other hand, the host is required 
to issue a Set Key Lock command on 
reception of a locked keycode, if that 
is what the interface dictates, because 
both normal keyboards and the terminal 
do not attempt to handle locking 
locally. This is because the terminal 
does not understand the keyboard or 
desired user interface semantics. 

The key lock bitmap is from the USB 
class definition for Boot Keyboards: 

0x01 Num Lock 

0x02 Caps Lock 

0x04 Scroll Lock 

0x08 Compose 

0x10 Kana 

All other bits are reserved — ignored 
on read, zero on set. 

Damage Repair This informs the client that all damage 
messages for sequence number SEQ in 
epoch EPOCH and earlier have been 
processed and repair data sent, (see 
the Damage back-channel command) . 
PAD must be 0. X, Y, WIDTH, and 
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HEIGHT must be 0; 

Play Audio This plays 48kHz audio samples, and may 

be imbeded in a graphics command stream. 

An undefined number of streams are received 
by the terminal on a first-come-first-served 
basis. Streams axe allocated on an as-needed 
basis and are broken down when buffer 
starvation occurs (there is no data to play 
when its time comes — partially received 
buffers are error concealed and played) . 
The terminal corrects for timebase drift. 

Data is sent in an interleaved manner to aid 
in network error concealment. A sample sequence 
is split into an interleave size and at most 
1+ (sequence size) / (interleave size) samples 
are emmitted per packet. The samples are 
selected as follows: 

sample sequence [sample_size] ; 
int seqjnumber m 0; 

while (1) { ' 

get_samples (sequence, sample_size) ; 

for (i - 0; i < interleave_size; i++) { 
interleave_offset 

- random^select (0 . . interleave_size) ; 

packet «new_packet (secjjiumber, sarople_size, 
^ num_chan, num_chan7 

interleave_size, 
interleave^ f fset) ; 

for (j = int erleave_of fset; j < saraple_size; 
j +« interleave_size) 
emit (packet , sequence [ j ] ) ; 

send_packet (packet ) ; 

) 



seq w number « (seq_aumber+l) %16; 

) 

note that the order that the packets are sent 
can (and probably should) be random. 

For example, for an interleave of 3 and 
and sequence size of 8, the following three 
packets could be sent: 

(samples) (01234567) 

pkt 1, off I: ' i 4 7 

pkt 2, off 0: 0 3 6 

pkt 3, off 2: 2 5 

The sequences .are numbered so that the terminal 

knows when to error conceal 'and emit a sample 
sequence. 
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Samples are 48kHz, 16 bit linear, and may 
contain up to 16 channels. For example, 
a 5-channel sample would take 10 consecutive 
bytes . 

There is no definition for the number of' 
audio channels supported by the terminal, . 
nor any way to find out, but up to 16 
channels can be sent at once. Since there 
may be a different number of channels sent 
than the terminal supports, the concept of 
a standard mix is introduced for the first 
8 channels. This may be disabled by setting 
the "MIX* field that guarantees certain 
indexed channels are not to be mixed together. 
The last 8 channels are mixed in the same 
scheme as the first 8 so that sound may 
be heard. If there are sufficient 
channels, then results are terminal setup 
dependent . 

The standard assigned channels are as follows: 
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(l«left, r«right, r[lr] -rear {left, right } 

sw-subwoofer, cf=center fill, 

c [ lr ) =cent er { le f t , right } , t op=cent er-cent er 

For example, if there are two speakers and 
one channel is sent with the standard mix 
enabled, the one channel will be sent to 
both the left and right speakers. Conversely, 
if the same terminal were sent 6 channels, 
channels 0,2,4,5 will be mixed and sent to 
the left speaker and channels 1,3,4,5 will 
be mixed and sent to the right speaker. 

The terminal speakers are set up in the 
same manner. 

The full mixing matrix is available in the . 
full specification. 

There may be no commands in the display 
stream for a period of time following 
this command; therefore, this is a good 
point for clients to flush all unfinished 
rendering to the screen. 'The epoch field 
provides 32 additional high order bits 
tor the sequence numbers. FILL consists 
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of 16 bytes set to all OxFF. This command 
provides an opportunity to re-synchronize 
data stream after a drop-out. 

The sequence number of a flush command 

is normally the same as the last 

non- flush command. However, when a epoch 

is exhausted, (i.e. . the sequence 

number of the last command is OxFFFFFF) , 
a flush command with a sequence number 
of zero and a new epoch number 
(incremented by 1) is sent. 



Back-channel Commands 

Wire Protocol Status Message Formats 

The basic status command format is: 
<COMMAND:8> <TIME:24> <lnfo> 



COMMAND 



Code <lnfo> Description 



Keyboard State Oxcl 



Pointer State 0xc2 



Active Region 0xc3 
Damage 0xc4 



<INDEX:8> <COUNTRY_CODE : 8> 
<L0CKS:8> <MODIFIERS : 8> 
<KEYCODE:8>[8] 

<INDEX:8> <DIM:2> <BUTTONS:6> 
<X:16> {<Y:16> 

{<Z:16> {<P:16> <R:16> <H:16>}}) 

note that all values are signed, 
2's compliment. Angular values 
range from -180 to +180- (1 
lsb) -+179.9945 (degrees over 
full range. 



DIM 

0 
1 
2 
3 



Dimensions 



X 

X, Y 

X, Y f Z 

X, Y, Z, p, R, H (yaw) 



<X:16> <Y:16> <WIDTH:16> <HEIGHT:16> 

<EPOCH:32> <PAD0:8> <SEQ L:24> 
<PAD1:8> <SEQ H:24> 
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Note: TIME is in microseconds; it wraps after 2»*24 
(approx 16 seconds) . 



Status Message Descriptions 



Command Description 



Keyboard State Reports the state of the <INDEX>'ed keyboard. 

The country code is from the USB Device Class 
Definition for HIDs, section 6.2. The locks 
are from the USB class definition for boot 
keyboards : 

0x01 Nuro Lock 
0x02 Caps Lock 
0x04 Scroll Lock 
0x08 Compose 

0x10 * Kana 

The ' Set Key Locks' command may be used to 
reset these locks/ and should be used if 
a lock key is detected at the host since 
keyboards generally don't locally handle 
lock status, and the terminal certainly 
doesn't either. Bits other than those 
specified are reserved and should be 
ignored. On set, they should be set to zero. 

The modifier bits are from the USB class 
definition for boot keyboards as well: 



0x01 


Left Control 


0x02 


Left Shift 


/ 0x04 


Left Alt 


0x08 


Left GUI 


0x10 


Right Control 


0x20 


Right Shift 


0x40 


Right Alt 


0x80 


Right GUI 



There is always space for six key scancodes. 
All keys (that are not modifiers) that are 
pressed are reported, up to six keys. This 
provides simple roll-over and chording 
capabilities. The scan codes are from the 
USB class definition for boot keyboards. 

Of special note is code 0x00 denoting no 
event in the slot, and 0x01 in all slots 
indicates that more than 8 keys have been 
pressed. Modifiers are still reported in 
this state. Once less than ^ keys are pressed, 
normal reports resume. 'Report order is 
arbitrary and does not reflect order of 
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events . ' 

pointer State Reports the state of the <INDEX>'ed pointer. 

DIM indicates the number of dimensions 
reported: 1, 2, 3/ or 6. The buttons 
are from the USB class definition for 
boot keyboards, bit zero is the 'primary' 
button (on the left), and the numbers 
increase from lef t -to-right . The 
reported values are all absolute and 
are signed, two' s compliment . 

Active Region Indicates the area of the logical 

framebuf fer th^t is retained on the 
newt. Specifically, this is the area 
that the "from" region of Copy rendering 
commands can be specified successfully. 

This region may change over time on a 
given client, for example, due to a 
pan-and-scan style of interface in a 
hand-held device. Also, different 
client devices may report different 
active regions. 

Damage Indicates that downstream (render) 

commands from sequence number SEQ_L 
through and including sequence number 
SEQ_H in epoch EPOCH were not received 
by the client from the server . PADO 
and PAD1 must be 0. 

The client will continue to report 
damage until a Damage Repair message 
for the affected sequence number is 
received. 

If SEQ_L is 0, then the full current 
screen image must be sent. 

Once, a damage message is sent for a 
given sequence number, no new subsequent 
damage may be sent for earlier sequence 
numbers. However, it is permissible 
to collapse two or more ranges into one 
in order to save space in later 
status packets. 



DPCM YUV Description: 

Further compression of YUV data is possible with the LUMA_ENCODING of 1. 

Luma data is encoded as follows: 
for each line 
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last_value - 0x80 

foreach lumarvalue 1 in line 

diff - 1 - last_value 

q value - quant [diff] 

last_value - clamp [last_value + dquant {q_value J J 
emit q_value 

end 

end 

Luma data is decoded as follows: 
for each line 

last_value « 0x80 

foreach quantization-value q^value in line 

last_value - clamp Elast_value + dquant {(Rvalue] J 
emit last_value 

end 

end 



Clamp is a clamping table; clamp [i] is: 

0 if i < 0; 
255 if i > 255; 

1 otherwise . 



The quantizer used is: 

Difference code rquant 
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1 . A method for interacting with a computer system comprising: 
accessing a first computer in said computer system using an identifier; 
authenticating said user on a server in said computer system using said 

identifier; and 

directing one or more services to said first computer system, if said user is 
authenticated on said server. 

2. The method of claim 1 further comprising: 
disconnecting from said first computer; 
continuing to execute said services. 

3. The method-of claim 2 further comprising: 

re-connecting on a second computer in said computer system using said 

identifier; 

authenticating said user on said server in said computer system using said 

identifier; and 

directing said services to said second computer system, if said user is 
authenticated on said server wherein said services continued to execute when said user 
was disconnected from said first computer. 

4. The method of claim 3 wherein said first and second computers are human 
interface devices. 
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The method of claim 3 wherein said identifier is a smart card. 



6. The method of claim 3 wherein said identifier is a PIN number. 

5 7. The method of claim 3 wherein said identifier is a bio-metric identifier. 

8. The method of claim 2 wherein said step of disconnecting is accomplished 
by pressing a sign-off button. 

10 9. The method of claim 2 wherein said step of disconnecting is accomplished 

by removing a smart card. 

1 0. A computer program product comprising: 

a computer usable medium having computer readable program code 
embodied therein configured to interact with a computer system, said computer program 
product comprising: 

computer readable code configured to cause a computer to access a first 
1 5 computer in said computer system using an identifier; 

computer readable code configured to cause a computer to authenticate 
said user on a server in said computer system using said identifier; and 

computer readable code configured to cause a computer to direct one or 
more services to said first computer system, if said user is authenticated on said server. . 

20 

1 1 . The computer program product of claim 1 0 further comprising: 
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computer readable code configured to cause a computer to disconnect from 
said first computer; 

computer readable code configured to cause a computer to continuing to 
execute said services. 

12. The computer program product of claim 1 1 further comprising: 
computer readable code configured to cause a computer to re-connect on a 

second computer in said computer system using said identifier; 

computer readable code configured to cause a computer to authenticate 
said user on said server in said computer system using said identifier; and 

computer readable code configured to cause a computer to direct said 
services to said second computer system, if said user is authenticated on said server 
wherein said services continued to execute when said user was disconnected from said 
first computer. 

13. The computer program product of claim 12 wherein said first and second 
computers are human interface devices. 

14. The computer program product of claim 12 wherein said identifier is a 
smart card. 

15. The computer program product of claim 12 wherein said identifier is a PIN 
number. 
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1 6. The computer program product of claim 1 2 wherein said identifier is a bio- 
metric identifier. 



1 7. The computer program product of claim 1 1 wherein said computer . 

5 readable code configured to cause a computer to disconnect is accomplished by pressing a 
sign-off button. 

1 8. The computer program product of claim 1 1 wherein said computer 
readable code configured to cause a computer to disconnect is accomplished by removing 

10 a smart card. 

19. An environment for interacting with a computer system comprising: 

a first computer in said computer system configured to be accessed using 

an identifier; 

1 5 an authentication manager on a server in said computer system configured 

to verify said user using said identifier; and 

a session manager configured to direct one or more services to said first 
computer system, if said user is verified on said server by said authentication manager. 

20 20. The environment of claim 19 further comprising: 

a disconnector configured to determine when said user disconnects from 
said first computer wherein said services continue to execute. 



2 1 . The environment of claim 20 further comprising: 
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a second computer in said computer system wherein said user re-connects 
to said second computer using said identifier; 

said authentication manager configured to verify said user on said server in 
said computer system using said identifier; and 

said session manager configured to direct said services to said second 
computer system, if said user is verified on said server by said authentication manager 
wherein said services continued to execute when said user was disconnected from said 
first computer. 

22. The environment of claim 20 wherein said first and second computers are 
human interface devices. 

23. The environment of claim 20 wherein said identifier is a smart card. 

24. The environment of claim 20 wherein said identifier is a PIN number. 

25. The environment of claim 20 wherein said identifier is a bio-metric 
identifier. 

26. The environment of claim 19 wherein said disconnector operates when 
said user presses a sign-off button. 

27. The environment of claim 19 wherein said disconnector operates when 
said user removes a smart card. 
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